Skip to content

Conversation

@CISC
Copy link
Collaborator

@CISC CISC commented Mar 15, 2025

The K-norm dimensions were calculated wrong (assumed to be the same as Q-norm).

Fixes #12376

@CISC CISC changed the title llama : support OLMo-2-0325-32B-Instruct (#12376) llama : support OLMo-2-0325-32B (#12376) Mar 15, 2025
@ggerganov ggerganov merged commit 8ba95dc into ggml-org:master Mar 16, 2025
47 checks passed
@CISC CISC deleted the olmo2-0325-fix branch March 16, 2025 18:19
arthw pushed a commit to arthw/llama.cpp that referenced this pull request Mar 19, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

OLMo-2-0325-32B-Instruct GGUF wrong tensor shape

2 participants